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ABSTRACT 

A study to analyze selected shortwave broadcasts in 
terms of the Flesch formula for readibility is presented. The study 
attempted to qualify elements of style based on their scripted word 
usage and to compare and contrast the news broadcasts of four 
countries in terms of gross listenability. A number of studies were 
conducted which applied the Dale-Chall formula and the Flesch 
formula, as well as tests on the listenability- readability concept. 
News scripts of the Voice of America’s English language broadcasts to 
Southeast Asia over the period of one week were examined. In 
addition, the shortwave news broadcasts of Russia, Britain and West 
Germany were taped and examined. It was found that on the basis of 
the scores recorded for the Voice of America broadcast that the news 
reports may have been prepared at a more difficult level than was 
intended. The study indicates that the matter of style evaluation 
should be given serious consideration by U.S.I.A. (CK) 
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The Comparative Listenability 
of Shortwave Broadcasts 

By M, Timothy O’Keefe 

► At present, most international short- 
wave broadcasting is conducted by na- 
tional governments with one purpose 
in mind: to attempt to favorably dis- 
pose the listeners to the point of view 
of the national government. 

Various audience surveys have been 
conducted to determine who and what 
kind of people listen to these broad- 
casts. However, little work appears to 
have been done in examining the con- 
tent of the broadcasts in an attempt to 
deduce the probable makeup of the au- 
dience. 

The purpose of this study was to an- 
alyze selected shortwave broadcasts in 
terms of the Flesch formula for reada- 
bility.^ The study attempted to quanti- 
fy elements of style based on their 
scripted word usage and to compare 
and contrast the news broadcasts of 
four countries in terms of gross listena- 
bility. 

There is considerable basis for the 
application of readability formulae — 
which predict the reading ease of writ- 
ten materials — to the spoken language. 

One of the first studies which at- 
tempted to show the validity of meas- 
uring listenability in terms of readabil- 
ity was conducted by Chall and Dial.® 
Applying the Dale-Chall formula and 
that of Flesch to 18 newscasts heard 
by college freshmen, they found that 
predictions of readability can be ap- 
plied to listening difficulty. 

Correlations of .74 for the Dale- 
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Chall formula and .72 for the Flesch 
formula were found between readabil- 
ity scores for the material and actual 
listener comprehension. It was found 
that judgments of interest and of dif- 
ficulty correlated .93. 

Cartier, in testing three difficulty 
levels of seven stories, found that the 
difficulty predictions did appear to be 
consistent with listener comprehension 
scores.® He found that the human in- 
terest aspect as defined b^ Flesch had 
no significant effect on listenability. 

A more extensive series of tests were 
run by Harwood on the listenability- 
readability concept. He found, as might 
be expected, that language rated in the 
“difficult” categories was more com- 
prehensive when presented for reading 
than for listening.^ 

In examining the rate of copy pre- 
sentation to an audience, Harwood 
found that while in general listenability 
did decrease with an increase in the 
speed of presentation, mean listenabili- 
ty at each of the four rates studied did 
not differ significantly.® 

He concluded that readability scores 
might be used as gross indicators or 
predictors of listenability if accuracy 
of the order not more than plus or 
minus one rank of listenability within 
a total range of seven (the Flesch 
scale) is acceptable. The scale runs 
from the very difficult to the very easy. 
(See Table 1) 

Carter has studied the cross-cultural 
application of the Flesch formula as a 
predictor for readability and found the 
results satisfactory.® Using a group of 
Filipino college students, he found that 
the Flesch reading ease correlated .79 
with the students’ rating of the material 
on the easy/difficult dimension. 

Procedure 

No cross-cultural applications of the 
Flesch formula to listenability could be 
found, but it did not seem unreasona- 
ble to assume that many of the factors 
uncovered above would hold true for a 
foreign audience, since Carter’s study 
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TABLE 1 

The Flesch Rating System 



Reading Ease 


Description 


Score 


of Style 


0 to 30 


Very Difllcull 


30 to SO 


Difficult 


SO to 60 


Fairly Difficult 


60 to 70 


Standard 


70 to 80 


Fairly Easy 


80 to 90 


Easy 


90 to 100 


Very Easy 


showed that the same 


factors that de- 



tcrminc reading comprehension for 
American audiences are also valid for 
foreign nationals. 

With this in nund, news scripts of 
the Voice of America's English lan- 
guage broadcasts to Southeast Asia ov> 
er the period of one week were exam- 
ined according to the Flesch reading 
ease formula. On the basis of earlier 
research, the Human Interest formula 
was not included because it appears to 
have been proven unreliable as a meas- 
ure of listenabllity.’ 

Half of the VOA scripts were in 
the regular English broadcasts, aimed 
rimarily at the opinion leaders in 
outheast Asia, such as journalists, 
teachers and college students. 

The other half were in Special Eng- 
lish, a simplified form of English that 
is intended for listeners who are not 
fluent in the language. The Special Eng- . 
lish scripts are limited to a 1200-word 
vocabulary and are spoken more slow- 
ly than normal news oroadcasts. 

In addition, the shortwave news 
broadcasts of three other countries— 
Russia, Britain and West Germany — 
were taped and examined according to 
the Flesch reading ease formula. 

By such an examination it was in- 
tended to show the difficulty levels of 
the different broadcasts in relation to 
one another and in relation to the type 
of audience being reached according to 
the Flesch educational index. 



Typical 
Magazine 

Scientific 
Academic 

Quality 

Digests 

Slick 
Fiction 

Pulp 
Fiction 

Comics 

Findings 

Regular Versus Special English. The 
results showed that, according to the 
Flesch readability scores, the Voice of 
America material was aimed at a high 
education audience level. In the Special 
English broadcasts the highest scoring 
single news story rated a 72.498, con- 
sidered to be “fairly easy," but the ov- 
erall average for this Sp^ial group was 
a 50.609, which is bordering just be- 
tween “difficult" and “fairly difficult.” 
Table 2 shows the results by news cate- 
gories. 

This score of 50.609 for Special 
English was slightly higher than that 
for the regular English broadcasts, 
which rated a 42.189 for the week. 

Pour of the Special English news 
categories scored in the 60s or the 
standard level of difficulty, while none 
of the regular English transmissions 
were this high. Only one regular Eng- 
lish broadcast category scored as high 
as “fairly difficult"; eight were at the 
“difficult” level and two noted as “very 
difficult.” 

The Special English broke down in 
this manner: four were in the standard 
level of difficulty, two were in the “fair- 
ly difficult" category and six were in 
the “difficult" category. 

The Four-Country Comparison. The 
tapes of the broadcasts in the four- 
country comparison were taken from 
a period different from that used in the 



Esiiniated Schooling 
Needed for Comprehension 

College 

High School or Some 
College 

Some High School 
7th or 8th Grade 
6th Grade 

5 th Grade 

4th Grade 
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Research in Brief 
TABLE 2 

A Comparison of the Regular English and Special English 
Broadcasts of the Voice of America to Southeast Asia 
According to the Flcsch Formula for Reading Ease 



Regular English ’ 
Overall score: 42,189 


News Subject 
Category 


Special English 
Overall score: 50.609 


44.541 


Vietnam 


42.899 


41.941 


Middle East 


47.862 


31.755 


Pope Paul 


63.321 


42.569 


United States 


49.154 


54.379 


Accidents 


62.073 


26.744 


Russia 


37.784 


37.433 


Asia 


52.348 


29.201 


Africa 


35.078 


— 


Europe 


52.250 


46.33! 


Space News 


62.169 


43.741 


United Nations 


43.059 


33..S74 


Miscellaneous 


62.729 







regular and Special English compari* 
son. The VOA broadcasts used were 
the regular English news reports to 
Southeast Asia. The Moscow, British 
and West German reports, also in Eng- 
lish, were beamed to the U.S. 

The comparison of these news re- 
ports showed that the Voice of Ameri- 
ca broadcasts (at 48.570 or a “difficult" 
rating) were at an easier level than 
those of the others but not to any great 
extent. The other three countries were 
also rated “difficult" and very closely 
grouped: Radio Deutsche was 

ranked second with a 40.7l5; the 
B.B.C. World Service was next with a 
38.269, and Radio Moscow was last 
with a 37.239. 

The only subject category that 
was covered with any consistency by 
these four countries was the Vietnam 
situation. None of the other news cate- 
gories were reported often enough by 
all four to supply what would be con- 
sidered an adequate sample of several 
hundred words. 

The Vietnam scores were as follows: 
Voice of America, 46.657; Radio Deut- 
sche Welle, 40.160; Radio Moscow, 



36.463; and B.B.C. World Service, 
32.028. 

Discussion 

It would appear on the basis of the 
scores recorded for the Voice of Amer- 
ica Special. English broadcasts that 
these news reports may have been pre- 
pared at a more difficult level than was 
intended. 

L. John Martin, chief of the Pro- 
gram Analysis Division, Office of Poli- 
cy and Research of the United States 
Information Agency, outlined the tar- 
get audience in this way: 

The audience we attempt to reach 
through our radio broadcasts to South- 
east Asia may be thought of in terms 
of a primary and secondary one. Our 
primary target audience comprises opin- 
ion leaders such as journalists, teachers, 
college students and decision makers in 
ail walks of life. This audience is made 
up of adults with at least a secondary 
education. But since radio is a mass 
medium, and since physical communi- 
cations are not very well developed in 
that part of the world, we also try to 
reach the farmers and villagers and 
more especially their leaders. These peo- 
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pie do not always have a formal edu- 
cation beyond the primary level . . Spe- 
cial English ... is intended for listeners 
who are not fluent in the language." 

According to the Flesch educational 
scaling, most of the listeners to the 
Special English broadcasts would have 
the equivalent of at least a seventh 
grade American education to under- 
stand even the simplest broadcasts. Lis- 
teners would require some high school 
or college training to understand fully 
all the news reports. 

The Voice of America may also be 
unnecessarily limiting its audience with 
its regular English broadcasts. Harwood 
reported that as material became more 
difficult, it was significantly more com- 
prehensible when presented for read- 
ing than for listening.® Virtually all of 
the regular English broadcasts fell in 
one of the difficult categories, and thus 
may have caused greater comprehen- 
sion difficulty than the scores point out. 

The Voice is broadcasting to an au- 
dience whose native language is not 
English. Yet when its listenability score 
was compared to that of three other 
stations who were broadcasting to Eng- 
lish speaking audiences, the VGA’s lis- 
tenability was not rated as being much 
easier than the others. 

Of course the only reliable way to 
verify these findings is with an on-the- 
spot analysis of the audience receiving 
the news reports. The listenability 
scores reported here are intended to 
serve only as rough estimates. 

Perhaps it will be found that the 
Voice of America should re-evaluate 
its style much in the same way the As- 
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sociated Press did some years ago when 
it learned that it was writing above its 
audience. 

The style could be made more listen- 
able without sacrificing quality or giv- 
ing the audience the impression that it 
is being talked down to. This would be 
such a minor change, and the possible 
advantageous results would make the 
effort worthwhile. It appears that no 
charge of oversimplification was made 
against the AP after it improved its 
readability. 

The study indicates that the matter 
of style evaluation should be given se- 
rious consideration by U.S.I.A. 

I Readability formulae are a method of measure- 
ment intended as predictive devices that provide 
quantitative, objective estimotes of the style difn- 
culty of writing. The idea behind readability meas- 
urement Is the matching of reoder and printed 
material. It assumes tliat readers dilTcr in their 
ability to read and that the printed material in turn 
varies in readability: that the material varies in the 
amount and kind of ability needed to read and 
understand It. The Flesch reading ease formula, 
which Is considered one of die most reliable, meas- 
ures style difficulty according to sentence length 
and the number of syllables per 100 words. Since 
1923 at least 29 methods of measuring readability 
have appeared In the llteroture. 
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3 F. A. Cartier Jr., “Llstenoblllty and Reader- 
ship Formulae,** Speech Monosraphs, 22:53-7, 
March 1955. 

'^Kenneth Harwood, “Listenability and Reada- 
bility,** Speech Monographs, 22:49-53, March 1955. 

B Kenneth Harwood, “Listenability and Rate of 
Presentation.** Speech Monographs, 22:57-9, March 
1955. 

> R. E. Carter Jr., “Cross Cultural Application 
of Four Flesch Formulas,** Journalism Quartbr- 
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^ Oeorge R. Klare, The Measurement of Reada- 
bility fAmes: Iowa State University Press, 1963), 
pp. 148-53. 
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* Harwood, “Listenability ond Readability,** p. 
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